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In the Claims: 

Please amend the claims as follows: 

1. (Currently Amended) Method for performing event detection and object 
tracking in an image stream, wherein an event is defined as the 
occurrence of a type of activity in field which requires some type of action 
in response thereto, said method comprising: 

a) installing in the field, an image acquisition device for acquiring an 
image stream and comprising a local programmable processor for 
converting the acquired image stream, consisting of one or more 
images, to a digital format, and a local encoder, preprogrammed to 
operate with an image processing server via a data network on the 
basis of distribution of image processing algorithms between the 
local encoder and the server, said local encoder being operable to 
apply low-level feature extraction to the digital format of fer- 
g e n e rat i ng, from said image stream, for selectively generating, from 
said image stream a non - imag e feature stream data, sa i d non - 
i mag e f e atur e data including parameters related to attributes of 
areas in said image stream, af»d for transmitting the a non i mag e 
feature stream via the data network to the image processing server 
conta i n i ng sa i d f e atur e s ; and 

b) connecting said image acquisition device to a the data network 
through a corresponding data communication channelff;]] , to enable 
the operation of the encoder by the image processing server and 
transmission of the feature steam from the image acquisition device 
to the image processing server, thereby actuating high-level 
processing applications at the image processing server to detect 
the event. 
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g) conn e ct i ng an i mag e proc e ssing s e rv e r to sa i d data n e twork; 

d} d e t e ct i ng sa i d e v e nt from ana l yzing sa i d non i mag e f e atur e str e am 

by sa i d i mag e proc e ss i ng serv e r and; 

e) transm i tt i ng, by sa i d i mag e proc e ss i ng s e rv e r, i nd i cat i ons r e gard i ng 

sa i d e v e nt i n sa i d i mag e str e ams to an op e rator. 

2. (Currently Amended) Method according to claim 1 , wherein the local 
encoder is a composite encoder, b ei ng th e loca l e ncod e r that furth e r which 
comprises circuitry for compressing the image stream, and further comprising: 

a) operating said composite encoder in a first mode, during which it 
generates and transmits said non -i mage feature stream to said image processing 
server, and 

b) operating said composite encoder in a second mode responsive to 
detecting said events, during which it transmits to said image processing server, 
in addition to said non i mag e feature stream, at least a portion of said image 
stream in a desired compression level, according to commands sent from said 
image processing server. 

3. (Cancelled) 

4. (Original) Method according to claim 1 , further comprising decoding 
one or more compressed image streams containing events by said server, and 
transmitting the decoded image streams to the display of an operator, for 
viewing. 
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5. (Previously Presented) Method according to claim 2, further 
comprising recording one or more compressed image streams obtained while 
said local encoder operates in said second mode. 

6. (Original) Method according to claim 2, further comprising dynamically 
allocating additional image processing resources, in the server, to data 
communication channels that receive image streams. 

7. (Cancelled) 

8. (Previously Amended) Method according to claim 6, further 
comprising generating and displaying a graphical polygon that encompasses an 
object of interest, being within at least one of a frame of an image and an area of 
interest in said image. 

9. (Previously Amended) Method according to claim 8, further 
comprising generating and displaying a graphical trace indicating the history of 
movement of an object of interest, being within at least one of the frame of an 
image and an area of interest in said image. 

1 0. (Previously Amended) Method according to claim 1 , wherein the 
image stream is selected from a group of images that comprises video streams, 
still images, computer generated images, pre-recorded digital video data and 
analog video data. 

1 1 . (Original) Method according to claim 1 , wherein the image streams are 
video streams, compressed using MPEG format. 

12. (Cancelled) 
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1 3. (Currently Amended) Method according to claim 1 , wherein the aen- 
i mag e feature stream data includes at least one of: 

a motion feature; 

foreground feature 

a color feature; 

edge data; and 

frequency related information. 

14. (Currently Amended) Method according to claim 1 , further 
comprising performing, by the server, at least one of: 

License Plate Recognition (LPR); 

Facial Recognition (FR); 

detection of traffic rules violations; 

behavior recognition; 

fire detection; 

traffic flow detection; and 

smoke detection, 

using the non i mag e feature stream received from the image acquisition 
device, through the data communication channel. 

1 5. (Currently Amended) System for use in performing event detection and 
object tracking in image streams, wherein an event is defined as the occurrence 
of a type of activity in field which requires some type of action in response 
thereto, said system comprising: 

a) an image acquisition device T for installation i nsta lle d in the field, the 
image acquisition device comprising: 
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a. 1 ) a local programmable processor for converting the acquired 
image stream to a digital format; and 

a. 2) a local encoder, preprogrammed to operate with an image 
processing server via a data network on the basis of 
distribution of image processing algorithms between the 
image acquisition device and the server, said local encoder 
being operable for generating, from said image stream, nofl- 
i mag e a feature stream data, sa i d non -i mag e f e atur e data 
including parameters related to attributes of areas in said 
image stream , and for tr a nsm i tt i ng a f e atur e stream 
conta i n i ng sa i d non - imag e f e atur e data ; 

b) a data n e twork, to wh i ch the i mag e acqu i s i t i on d e v i c e i s conn e ct e d 
through a corr e spond i ng data communication channel connecting 
the image acquisition device to the data network and operable for 
transmitting the feature stream generated by the local encoder to 
the image processing server, thereby actuating high-level 
processing applications at the image processing server to detect 
the event in the field ; 

c) a remote image processing server connected to said data network, 
said remote image processing server receiving said feature stream 
transmitted by said local encoder; and 

d) said remote image processing server detecting said event from 
analyzing said feature stream, and transmitting indications 
regarding said event to an operator. 
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16. (Previously Amended) System according to claim 1 5, wherein said local 
encoder is a composite encoder and further comprises circuitry for compressing 
said image stream, said composite encoder having a first operating mode, during 
which it generates and transmits said feature stream to said remote image 
processing server, and having a second operating mode, during which said 
composite encoder transmits to said remote image processing server, in addition 
to said feature stream, at least a portion of said image stream in a desired 
compression level, according to commands sent from said remote image 
processing server. 

1 7. (Previously Amended) System according to claim 1 6, further 
comprising the remote image processing server decoding said portion of said 
image stream and determining said portion of said image stream contains an 
event; and 

an operator display, for receiving said portion of said image steam, 
containing the event from the remote image processing server. 

18. (Previously Amended) System according to claim 1 6, further 
comprising a network video recorder for recording one or more image streams T 
obtained while said composite encoder operates in said second mode. 

1 9. (Currently Amended) System according to claim 46 17, in which the 
remote image processing server is capable of dynamically allocating image 
processing resources to said data communication channel when said data 
communication channel receives said portion of said image stream. 

20. (Previously Amended) System according to claim 16, in which said 
portion of said image stream obtained while operating in the second mode, 
comprises only a portion of the image that corresponds to a desired area of 
interest. 
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21 . (Currently Amended) System according to claim A% 17, in which the 
remote image processing server further comprises processing means for 
generating and displaying a graphical polygon that encompasses an object of 
interest, being within at least one of a frame of an image and an area of interest 
in said image when said composite encoder is in said second operating mode. 

22. (Previously Amended) System according to claim 21 , in which the 
remote image processing server further comprises processing means for 
generating and displaying a graphical trace indicating the history of movement of 
an object of interest, being within at least one of the frame of said image and the 
area of interest of said image. 

23. (Original) System according to claim 15, in which the image stream is 
selected from the group of images that comprises video streams, still images, 
computer generated images, and pre-recorded digital or analog video data. 

24. (Previously Amended) System according to claim 15, in which the 
image stream is a video stream compressed using MPEG format. 

25. (Cancelled) 

26. (Previously Amended) System according to claim 15, in which the 
feature stream includes at least one of: 

a motion feature; 

a color feature; 

edge data; and 

frequency related information. 
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27. (Currently Amended) System according to claim 45 17, in which the 
remote image processing server further comprises processing means for 
performing at least one of: 

License Plate Recognition (LPR); 

Facial Recognition (FR); 

detection of traffic rules violations; 

behavior recognition; 

fire detection; 

traffic flow detection; and 

smoke detection; 

using the feature stream T received from the local encoder of the image 
acquisition device, through the data communication channel. 

28. (Canceled) 

29. (Canceled) 

30. (Currently Amended) Method according to claim 1 wherein said nofl- 
i mag e feature stream data further comprises a motion feature A afid said motion 
feature is being encoded in said feature stream only when said motion feature 
exceeds a predetermined threshold. 

31 . (Currently Amended) System according to claim 1 5 wherein said non- 
tmage-feature stream data further comprises a motion feature A and said motion 
feature \s being encoded in said feature stream only when said motion feature 
exceeds a predetermined threshold. 

32. (Currently Amended) A distributed image processing method for 
effectively performing event detection in a large number of concurrent image 
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sequences, wherein an event is defined as the occurrence of a type of activity in 
fields which requires some type of action in response thereto, said method 
comprising: 

a) performing low level feature extraction by encoders associated with 
i n th e v i c i n i ty of an image acquisition device s installed in the fields , said low level 
feature extraction comprising: 

i) receiving an image streams from the e ach of a p l ura li ty of 
image acquisition devices installed in the field s and generating digital data 
indicative thereof : 

ii) processing the digital data indicative of the image stream 
and selectively extracting therefrom a corresponding non -i mag e features stream 
having a bandwidth narrower than that of the corresponding image stream, from 
features in said feature i mag e stream including from e ach of sa i d p l ura li ty of 
i mag e acqu i s i t i on d e v i c e s, sa i d f e atur e s b ei ng parameters related to attributes of 
areas in the respective said image stream; 

iii) prior to detecting said event, generating a reduced 
bandwidth non-image feature stream for each said image stream, said reduced 
bandwidth non-image feature stream based upon said features; 

b) pr i or to d e t e ct i ng sa i d e v e nt, transmitting said reduced bandwidth 
non -i mag e feature stream from the for e ach of sa i d p l ura li ty of image acquisition 
devices to a common remote image processing serve r, thereby actuating the 
image processing server for ^aftd 

g) d e t e ct i ng e v e nts by performing high level image processing to 

detect events in the fields, at sa i d r e mot e imag e proc e ss i ng s e rv e r, sa i d h i gh 
le v el i mag e proc e ss i ng compr i s i ng: 
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r e c ei v i ng said r e duc e d bandw i dth non i mag e f e atur e str e am 

transm i tt e d from e ach of sa i d p l ura li ty of i mag e acqu i s i t i on d e v i c e s, 

ana l yz i ng e ach sa i d reduc e d bandw i dth non -i mag e f e atur e 

str e am at sa i d r e mot e i mag e proc e ss i ng s e rv e r, and 

fif) d e t e ct i ng e v e nts in e ach sa i d i mag e str e am bas e d upon sa i d 

ana l yz i ng of e ach sa i d reduced bandw i dth non -i mag e f e atur e 
str e am by sa i d r e mot e imag e proc e ss i ng serv e r. 

33. (Currently Amended) The method of claim 32 further comprising 
transmitting to said remote image processing server at least a portion of an 
image stream from any of said plurality of image acquisition devices associated 
with a the reduced bandwidth non -i mage feature stream in which said remote 
image processing server detects an event. 

34. (Currently Amended) The method of claim 33 , wherein said high level 
image processing comprises: receiving said reduced bandwidth feature stream 
transmitted from each of said plurality of image acquisition devices, analyzing 
each said reduced bandwidth feature stream at said remote image processing 
server, and detecting events in each said image stream based upon said 
analyzing of each said reduced bandwidth feature stream by said remote image 
processing server, and furth e r compr i sing displaying said image stream in which 
an event is indicated on a display screen of an operator at said remote image 
processing server. 

35. (Currently Amended) The method of claim 32 wherein said selective 
extraction comprises selectively encoding features ar e e ncod e d in said reduced 
bandwidth non i mag e feature stream only when at least one of a number and 
type of said features exceed a predetermined threshold, wherein said threshold 
is applied to said image acquisition device to control when said encoder 
generates and transmits said feature stream, and said number and type of 
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features exceeding said threshold are indicative of activity to be further analyzed 
by said remote image processing server in order to detect said event. 

36. (Currently Amended) The method of claim 35 wherein said transmitting 
said reduced bandwidth non -i mag e feature stream to said remote image 
processing server occurs only when said number and type of features exceed 
said predetermined threshold. 

37. (Currently Amended) The method of claim 35 wherein said features 
further comprise motion features, and said motion features are encoded in said 
reduced bandwidth non i mag e feature stream only when said motion features 
exceed said predetermined threshold. 

38. (Previously Presented) The method of claim 35 wherein said 
predetermined threshold is set by said remote server. 

39. (Previously Presented) The method of claim 32 further comprises 
recording said image stream when said event is detected therein. 

40. (Currently Amended) The method of claim 35 further comprising 
transmitting to said remote image processing server at least a portion of an 
image stream from any of said plurality of image acquisition devices associated 
with the a reduced bandwidth non -i mag e feature stream in which said remote 
image processing server detects an event. 

41. (Previously Amended) The method of claim 40 further comprising 
generating and displaying a graphical polygon that encompasses an object of 
interest within at least one of a frame of said at least a portion of an image and 
an area of interest in said at least a portion of an image. 
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42. (Previously Presented) The method of claim 41 further comprising 
generating and displaying a graphical trace indicating the history of movement of 
said object of interest. 

43. (Previously Amended) The method of claim 32 wherein said image 
stream is selected from a group of images comprising video streams, still 
images, computer generated images, pre-recorded digital video data and pre- 
recorded analog video data. 

44. (Currently Amended) The method of claim 32 wherein said non i mag e 
features stream comprises at least one of: 

a motion feature; 

a color feature; 

edge data; and 

frequency related information. 

45. (Currently Amended) The method of claim 32 34 wherein said s e cond 
proc e ss i ng st e p furth e r high level image processing comprises performing, by 
said remote image processing server, at least one of: 

License Plate Recognition (LPR); 

Facial Recognition (FR); 

detection of traffic rules violations; 

behavior recognition; 

fire detection; 

traffic flow detection; and 

smoke detection; 

using said reduced bandwidth non -i mag e feature stream received from at 
least one of said plurality of image acquisition devices. 
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46. (Currently Amended) A distributed image processing system for effectively 
performing event detection in a large number of concurrent image sequences, 
said distributed image processing system having an in field component and a 
remote component, wherein an event is defined as the occurrence of a type of 
activity which requires some type of action in response thereto, said distributed 
image processing system comprising: 

a) a low level feature extraction component located in field, said low 
level feature extraction component comprising: 

a plurality of image acquisition devices installed in field, each 
producing an image stream; 

a processor and an encoder associated with each of said plurality 
of image acquisition devices; 

said processor converting said image stream to a digital format; 

said encoder selectively extracting non i mag e feature data from 
said image stream and generating a reduced bandwidth non -i mag e feature 
stream therefrom, said non i mag e feature data including parameters related to 
attributes of areas in said image stream; 

b) a remote high level image processing component comprising a 
remote image processing server; 

c) a data network with which said low level feature extraction 
component communicates with said remote image processing server, each of 
said plurality of image acquisition devices and associated encoders 
communicating with said data network through a corresponding data 
communication channel; 
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d) wh e r ei n said encoder transm i ts transmitting said reduced 
bandwidth non i mag e feature stream to said remote image processing server 
pr i or to for detection of said an event; 

e) wh e r ei n said remote image processing server ana l yz e s analyzing 
said reduced bandwidth non -i mag e feature stream and thereby d e t e cts detecting 
said events associated with said image stream from e ach of sa i d p l ura li ty of 
i mag e acqu i s i t i on d e v i c e s ; and 

f) wherein, responsive to detecting said events, said remote image 
processing server causes at least a portion of said image stream associated with 
said events to be transmitted to said remote image processing server. 

47. (Currently Amended) The system of claim 46 wherein said encoder 
comprises a composite encoder which incorporates said processor, and further 
comprises circuitry for compressing said image stream, said composite encoder 
having a first operating mode during which said composite encoder transmits 
said reduced bandwidth non -i mage feature stream to said remote image 
processing server, and a second operating mode during which said composite 
encoder transmits to said remote image processing server, in addition to said 
reduced bandwidth non -i mag e feature stream, at least a portion of said image 
stream in a desired compression level, according to commands sent from said 
remote image processing server, said remote image processing server 
controlling said composite encoder to operate in said second operating mode 
responsive to detecting said events. 

48. (Canceled) 
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49. (Previously Amended) The system of claim 47 further comprising an 
operator display for receiving from said remote image processing server said 
image stream in which said event is detected. 

50. (Currently Amended) The system of claim 46 wherein said features are 
encoded in said reduced bandwidth non - imag e feature stream only when at least 
one of a number and type of said features exceed a predetermined threshold, 
wherein said threshold is applied to said image acquisition device to control when 
said encoder generates and transmits said feature stream, and said number and 
type of features exceeding said threshold are indicative of activity to be further 
analyzed by said remote image processing server in order to detect said event. 

51 (Currently Amended) The method of claim 50 wherein said reduced 
bandwidth non -i mag e feature stream is transmitted to said remote image 
processing server only when said number and type of features exceed said 
predetermined threshold. 

52. (Currently Amended) The system of claim 50 wherein said features 
further comprise motion features, and said motion features are encoded in said 
reduced bandwidth non -i mag e feature stream only when said motion features 
exceed said predetermined threshold. 

53. (Previously Presented) The system of claim 50 wherein said 
predetermined threshold is established by said remote image processing server. 

54. (Previously Amended) The system of claim 47 further comprising a 
network video recorder associated with each of said plurality of image acquisition 
devices for recording said image stream when said composite encoder operates 
in said second operating mode. 
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55. (Previously Presented) The system of claim 47 wherein said remote 
image processing server dynamically allocates additional image processing 
resources to data communication channels receiving said image stream. 

56. (Cancelled) 

57. (Previously Amended) The system of claim 49 wherein said remote 
image processing server further comprises a programmable processor for 
generating and displaying on said operator display a graphical polygon that 
encompasses an object of interest within at least one of a frame of said at least a 
portion of an image and an area of interest in said at least a portion of an image. 

58. (Previously Presented) The system of claim 57 wherein said remote 
image processing server generates and displays on said operator display a 
graphical trace indicating a history of movement of said object of interest. 

59. (Previously Amended) The system of claim 46 wherein said image 
stream is selected from a group of images comprising video streams, still 
images, computer generated images, pre-recorded digital video data and pre- 
recorded analog video data. 

60. (Currently Amended) The system of claim 46 wherein said nofl- 
i mag e features stream comprises at least one of: 

a motion feature; 

a color feature; 

edge data; and 

frequency related information. 
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61 . (Currently Amended) The system of claim 46 wherein said remote 
image processing server performs at least one of: 

License Plate Recognition (LPR); 

Facial Recognition (FR); 

detection of traffic rules violations; 

behavior recognition; 

fire detection; 

traffic flow detection; and 

smoke detection; 

using said reduced bandwidth non i mag e feature stream. 
Please add claims 62-66 as follows: 

62. (New) Method for use in performing event detection and object 
tracking in image streams using a system formed by a set of image acquisition 
devices, each installed in field where an event is to be detected and connected to 
a central station through a data network, the method comprising: 

processing a digital format of an image stream, consisting of 
one or more images, to detect features, being parameters related to attributes of 
objects in said image stream, and, based on these features, performing the event 
detection and object tracking, wherein 

providing an image processing server remote from the field, said 
image processing server being preprogrammed to operate with each of the 
image acquisition devices on the basis of distribution of image processing 
algorithms between the image acquisition device and the server, said image 
processing server being preprogrammed for performing said distribution of image 
processing algorithms by carrying out the following: 

dynamically determining a threshold value for each feature, 
which is associated with the event to be detected and which is to be extracted by 
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the set of image acquisition devices from image data acquired thereby in the 
field, and updating each of the image acquisition devices with the corresponding 
threshold, 

in response to a feature stream, received from each of the 
image acquisition devices via the network, applying a high-level processing to the 
received feature stream to identify events in an image data to which said feature 
stream corresponds, and controlling an operational mode of the respective image 
acquisition device, to thereby enable transm i t transmission of output data to an 
operator. 

63. (New) A computer readable medium for use in performing event 
detection and extraction and object tracking, the computer readable medium 
containing instructions which, when executed by a processor, cause the 
processor to operate with each of multiple remote image acquisition devices via a 
communication network on the basis of distribution of image processing 
algorithms between the image acquisition device and said processor, by 
selectively carrying out the following: 

dynamically determining a threshold value for each of a plurality 
of predetermined features, which are parameters related to attributes of objects 
in an image stream to be captured by at least one of the remote image 
acquisition devices, and are associated with the event to be detected and 
extracted by the respective image acquisition device from image data acquired 
thereby in the field, and updating each of the image acquisition devices with the 
corresponding threshold, 

in response to a feature stream, received from at least one of 
the image acquisition devices via the network, processing the feature stream by 
applying a high-level processing to the received feature stream to identify events 
in an image data to which said feature stream corresponds, and controlling an 
operational mode of the respective image acquisition device, to thereby enable 
transmission of output data to an operator. 



19 



Application Serial No.: 10/501,949 
Attorney Docket No.: 014787.0005 



64. (New) System for use in performing event detection and object 
tracking in image streams, the system comprising an image processing server 
configured for connecting via a data network to a set of image acquisition devices 
each located in field where the event detection is to be performed, said image 
processing server being preprogrammed to operate with each of the image 
acquisition devices on the basis of distribution of image processing algorithms 
between the image acquisition devices and the image processing server, by 
determining and providing to each of the image acquisition devices a 
corresponding threshold for each feature that is associated with the event to be 
detected and is to be extracted by the image acquisition devices from image data 
acquired thereby, the image processing server being responsive to a feature 
stream, received from each of the image acquisition devices for applying high- 
level processing to the received feature stream, to control an operational mode of 
the respective image acquisition device and to identify events in the image data 
corresponding to the feature stream, to thereby enable transmission of output 
data to an operator. 

65. (New) A computer program for use in performing event detection and 
object tracking in image streams, comprising computer program code means 
which, when run on a computer causes the computer to: 

connect, via a data network, an image processing server to a 
set of image acquisition devices, each located in field where the event detection 
is to be performed; and 

cause the image processing server to operate with each of the 
image acquisition devices on the basis of distribution of image processing 
algorithms between the image acquisition devices and the image processing 
server by determining and providing to each of the image acquisition devices a 
corresponding threshold for each feature that is associated with the event to be 
detected and is to be extracted by the image acquisition devices from image data 
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acquired thereby, the image processing server being responsive to a feature 
stream, received from each of the image acquisition devices for applying high- 
level processing to the received feature stream, to control an operational mode of 
the respective image acquisition device and to identify events in the image data 
corresponding to the feature stream, to thereby enable transmission of output 
data to an operator. 

66. (New) The computer program as claimed in Claim 65 embedded on a 
computer readable medium. 
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